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We rigorously show that the probabihty to have a specific trajectory of an externally perturbed 
classical open system satisfies a universal symmetry for Liouvillian reversible dynamics. It connects 
the ratio between the probabilities of time forward and reversed trajectories to a degree of the time 
reversal asymmetry of the final phase space distribution. Indeed, if the final state is in equilibrium, 
then the forward and reversed net transition probabilities are equal, which gives a generalization of 
the detailed balance principle. On the other hand, when the external forcing maintains the system 
out of equilibrium, it expresses an asymmetry for the probabilities of the time forward and reversed 
' trajectories. Especially, it gives a microscopic expression of the heat flowing to a system from a 

reservoir where the subdynamics seems like a Markovian stochastic process. 
Mh ■ Also, it turns out that the expression of the microscopic reversibility holds both for the conserva- 

1^-^ ' tive and dissipative dynamics with an arbitrary initial state and external forcing. 
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I. INTRODUCTION 



The time reversal invariance of the equations of motion equally allows both time forward and reversed processes. 
c/2 ■ For the irreversible time evolution of macroscopic systems, however, we only observe one of them, the forward 
process. Indeed, the microscopic understanding of the macroscopic irreversibility is a long standing problem of the 
statistical physics. On the other hand, the reversed process can be observed through the fluctuation of quantities in 
mesoscopic systems [l|, [3] • Actually, the time reversal symmetry amounts to various fluctuation theorems and related 
nonequilibrium properties 0-113 ■ ^"^^ fluctuation theorem concerns with the probability of the entropy production 
fH ■ during the nonequilibrium process (23j. and expresses a universal balance between the positive and negative entropy 
Q ] production within a model independent framework. Also the relation to the linear and nonlinear response theories 
O ' has been established [tI [isl [T6| . and thus it plays a fundamental role in the nonequilibrium statistical physics. 

] For a Markovian stochastic dynamics, Ref.[ll] provides a unified perspective which connects a fluctuation theorem 
I . to nonequilibrium work equality based on the so-called microscopic reversibility. The validity of this theorem has been 
^ ■ confirmed for the overdamped and underdamped Markovian Langevin dynamics [2^ [25j with the use of an expression 
OO . of the heat essentially given in Rcf.[26]. 

' In this article, we rigorously investigate a corresponding microscopic reversibility for Liouvillian time evolutions 
for classical open systems. We show that the microscopic reversibility connects the ratio between the probabilities of 
time forward and reversed trajectories to a degree of time reversal asymmetry of the final state distribution. We also 
] explain some applications of the microscopic reversibility. 

. This paper is organized as follows. In Sec. II, we prepare our model and explain the basic properties of Liouvillian 
■ dynamics. In Sec. Ill, microscopic reversibility is derived. Some applications are shown in Sec. IV. Sec.V is devoted to 
a summary. 



II. MODEL 

We consider a deterministic dynamics in the phase space for a system interacting with reservoirs. Also our cal- 
culation accounts for the phase volume contraction, which does not necessarily contradict with the reversibility as 
explicitly shown in the appendix A. Let us denote the system- and reservoir- variables as Fj and F^.. They are com- 
posed of positions and momenta for Hamiltonian dynamics. The set of all variables {T^, F^} is abbreviated as F. An 
external perturbation acts on the system for < t < T in a certain forcing protocol. The initial state of the total 
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system is arbitrary. Note that a function of phase variables A{T{t)) evolves due to the temporal change of T{t) 

■ , , dA(T(t)) ■ , , 

- L(i)A(r(t)), (1) 

where L[t) is the Liouvillian operator. For Hamiltonian dynamics, it gives the Poisson bracket L(t)A(r) = 
{j4(r), iJ(r, i)} with a Hamiltonian H{T,t). On the other hand, the phase space distribution p{T,t) evolves as 

dp{r,t) 

dt 

= -(^+L{t)^p{T,t). (2) 

Note that the sign of the Liouvillian operator is different between Eq.(IT|) and ([2]). Then the conservation of probability 
is immediately obtained from 

j^pim.t) - L{t)p{T{t),t)-(^^^+L{t)^p{T{t),t) 

dm 



dm 



p{T{t),t) (3) 



as 



ft 3f (s) , 

p(r(t),t) = e-Jo^%(r(o),o). (4) 



III. DERIVATION OF MICROSCOPIC REVERSIBILITY 



We abbreviate the time evolution operator during < t < jAT as V,-. The trajectory is specified by 
the state at t — jAt as {rs(0), rs{At), rs(7VAt)} with a time step At = ^. The forward probability 
PF{{rs{Q),^s{At), ...,rs{NAt)}) to have such a trajectory is given as 

PF{{Ts{0),Ts{At),...,T,iNAt)}) 

N 

= drpiT,0)l[6{Ts{jAt)~{V,T),). (5) 

Eq.(l5]) actually gives the net transition probability that the system state at t = jAt is rs(jAi). Indeed, it satisfies 
the normalization condition for the net transition probability 

FF({r,(0), r,(Ai), T,iNAt)})dT,iO) ■ ■ ■ dV.iNAt) 
dTp{T,0) 

= 1- (6) 

Next, we define the probability for the time reversed trajectory {QTsiNAt), QTsUN - l)At), ers(At), er^O)} 
where & is the time reversal operator acting on the total system. Note that 6 maps the set of all the positions and 
momenta at time t {q{t),p{t) as <d{q{t),p{t)) ~ {q{T — t), —p{T — i)), i.e. the reversal with respect to time T. If 
there exists a magnetic field, we also reverse it, since the reversal of electron currents amounts to the reversal of the 
corresponding magnetic field[T6!|. The probability for the reversed trajectory is given as 

PRiieVsiNAt), eVsUN - i)At), er,(Ai), er,(o)}) 

N 

= I dTp{r,T) n <5(er,(jAt) - (ev^v^^er),). (7) 

j=0 
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We clarify that 9Vj V^^0 actually gives the reversed evolution operator from t = to t = {N—j)At. For simplicity, we 
here show this for Hamiltonian dynamics. The argument for thermostatted dynamics is similarly explained. Indeed, 
the time reversal consists of the reversal of the state F = {q{t),p{t)) 8F ~ {q{T — t), —p{T — t)) and the reversal of 
the external forcing protocol. Here q(t) and p(t) are the set of all the positions and momenta. The evolution operator 
is expressed by the time ordered product as 

VjvVri =T{e^'^t'i(*)''*} 

= lim eL{NAt)At^LaN-l)At) . . . gL((i+l)At)gLO-At) ^gN 
At^O ' 

where the finite time approximation becomes rigorous in the continuous limit At — >■ and NAt — )■ T. Using the 
property QL{t) = —L{t)Q and Eq.®, we have 

= lim e^(3^t)e,L((o + l)At) . . . ^L((N-l)At)^L(NAt) ^gN 

Next, we consider the time evolution of the reversed state {q{t),p{t)) = {q{T — t), —p{T — t)). For this purpose, let us 
evaluate the value of an arbitrary function A(q,p) at a time t + dt, 

A{q{t + dt),p{t + dt)) 
= A{q{t),P{t)) + L{T - t)A{q{t),P{t))dt + 0{dt') 

^ AiqiT - -piT - .)) - ( ^^%(l-f-^»^^^^-^^ + ^tH^^^^ - ^0 " ^^^^^^ 

(10) 

In the first equality, we used that {q{t),p{t)) is also a solution of the equations of motion. In the second equality, the 
sign of the terms of order dt are different from that of the forward process, because of the reversal of momenta and 
the derivative of A{q{T — t), —p{T — t)) with respect to p{T — t). Then one has 

Jim^e^(^-^*)e^((^+i)^*) • • • e^«^-^)^*)e^(^^*)A(9,p)b,,)=(,(o),p(o)) 

= Aiq{jAt),p{jAt)), (11) 

which shows that Eq.® actually gives the time reversed evolution operator during < < < {N — j)At. 
On the other hand, the forward transition probability is rewritten as 

Pi.({F,(0), F,(At), F,((iV - l)At), T,{NAt)}) 

N 



^ I dTp{T,Q)\{5(T,{3At) - (V,F),) 
- j d{VNT)\^^)\p{V^^VMT,Q)\[5{Ts{3At) - {V,V^'VnT)s) 

/rT af (t) , 
d{VN'r)e~Jo r',0) 

x[]5(F,(jAt)-(VjV^iF')s) 

3=0 

N 

= I dr'p{r',T)l[s{r^{jAt)-{v,V],'r')^) 

N 

dr'p{r',T)l[s{Qr,{jAt) - (ev^v^^F').) 

N 

= / d(eF')p(eF', T) H 6ier,{jAt) - (ev, v^v^eF').), 



(12) 
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where in the third equahty, we changed the variable from F to F' = V^vF, and apphed a generahzed Liouville theorem 
for F , ^ = e ° • In the fourth equahty, we used the conservation of the probabihty Eq.(|l)) 

e-Jo ar(t)''*p(Vj^iF',0) = p(F',T). (13) 
Indeed the Jacobian for a change of variables F — > VjyF turns to be 

|^(^|^e^o'»^ (14) 

in the Appendix B. In the fifth equality, we changed the variable as F' — > 8F'. Note that |^^^| = 1. In the Dirac 
delta, Ts is a set of variables and the time evolution operator acts on it, however, the quantities such as Fs(0) and 
rs(T) are constant. Here p(F,T) is the distribution function at t = T. 

Comparing Ea.([T^ with Eq.©, they look similar except for the time reversal in the statistical weight /ci(8F,T). 
Therefore, the forward probability is directly connected to the reversed probability as 

Pf({F,(0), F,(At), F,(r - Ai), F,(T)}) 



Pr{{QTs{T),QTs{T - At), OF^At), eF,(0)}) 

p(9F,r) p(F,r)nf^o'^(er,(jAt) - (ev.v^^er). 



dV- 



p(r,T) /drp(F,r)nf=o'5(er,o-Ai) - (ev.v^^er),) 

where is the average over the normalized transition probability that the reversed trajectory of the system state 
{QTs{NM), QTs{{N - l)At), eF,(At), eFs(O)} is observed. Taking the continuous limit Ai ^ and NM = T, 
we finally obtain a model-independent symmetry of the net transition probability functionals 

PpiTsit)] _, p(9r,r) 
Pfl[eF,(r-i)] \ p(F,r) ^ ' 

for a trajectory Fs(i) and its time reversal QTs{T — t). Eq. (jl6p is a universal expression of the microscopic reversibility. 
A notable feature of Eq. (ITBl) is that it connects the ratio between the forward and reversed net transition probability 
functionals Ppl^sit)] and PR[0Fs(r — t)] to a degree of the time reversal asymmetry of the final state distribution. 
It expresses how difiicult to achieve the time reversed trajectory compared with the forward trajectory. The physical 
implications of Eq. p^ are given in Sec. IV. 



IV. APPLICATIONS 



If the system is submitted to a thermalization process, the final state would be close to thermal equilibrium which 
is invariant under the time reversal p(0F,T) = p{T,T). In this case, the net transition probabilities of the forward 
and reversed trajectories are equal Ppl^sit)] — Pfi[Ts(T — t)], which is derived for quantum open systems submitted 
to a thermalization process [2?! [28|. Especially, when the equilibrium state is maintained including the initial state, 
Eq. ([T5)l corresponds to the detailed balance principle. 

When there is only one large reservoir at an inverse temperature /? and the time evolution of the subsystem is 
well-described by a Markovian stochastic dynamics, Refs.flll. |24|. [25j show that the ratio of the conditional transition 
probabilities is equal to the exponential of the heat e~'^'3[r(t)]_ jj-^ g■^J^Q]^ g, case, Eq. p^ provides a microscopic expression 
of the heat (5[r(^)]- To derive the expression of the heat, we introduce a conditional probability. The joint transition 
probability is rewritten as 

({F,(0), F,(At), Ts{{N - l)At),rs{NAt)}) 

= p(F,(o),o) J drP^£0i^f[s{T.{jAt)-{v,r).) 

= p(F,(0), 0)Pf({F,(0), F,(At), F,((iV - l)Ai), F,(iVAt)} : F,(0)), (17) 

where we defined a marginal distribution p(Fs(0), 0) = J dTrp(Ts{0), F^, 0) and the conditional transition probability 
PF{{Ts{0),Ts{At), Fs((iV- l)Ai), Ts{NAt)} : F^(0)) with which we have a trajectory {Fs(0), Fs(Ai), Fs((A^- 
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l)At),Ts{NAt)} provided that the initial state of the system is rs(0). The time reversed conditional probability is 
defined as well 

Pfl,({er,(r), er,(T - At), er,(At), er,(o)} : er,(T)) 
^ / ^^ ''^ p^eSnrf ^ flmr.ijAt) - (ev.v^^er),) (is) 

with a marginal distribution p(Ts,T) = J dTrp{Ts,rr,T). 

With the use of conditional probabilities, the microscopic reversibility is expressed as 

PF[rs{t):m] _ p(er,(r),r), p(er,r) , _ ^^^^ 



Pfl[er,(r-i) : er,(T)] p(r,(o),o) ^ p(r,r) 

On the other hand, this quantity is equal to e"'^'^''"*^*''! [ll|, [13, UHl- Thus we obtain a microscopic expression of the 
heat 

Q\m] - i,„ p(er.(r),T) p(9r,T) 

This expression gives an important condition Ea. (|2ip for thermalization processes. Let us consider the following case. 
The system is initially in equilibrium described by a canonical ensemble ^/(q) e~'^"^°^'"°'"-' with the system Hamiltonian 
Hs{rs,0), and externally perturbed during some transient time. Then the total system is left untouched so that it 
would thermalize. At the final time T, the total system is in equilibrium again, and therefore ''pf-p.T) ) r ~ ^■ 
Especially, the subsystem is described by another canonical ensemble Zs\t) e~^-^''^^'''^\ Then the heat averaged over 
the trajectories Q[r(t)] is calculated from Eq.(|20|) and canonical ensembles at t = 0,T as 

mm]) 

= H{HsirsiT),T)) - (ff,(r,(o),o)) - af^) 

AS , , 

(21) 



k 



B 



which shows that equality holds in the Clausius inequality for the entropy change AS. In the first equality, we 
identified the averaged difference of the Hamiltonians as an internal energy change AE. Here the free energy difference 
AFs — log calculated as AFs — AE — The appearance of a reasonable condition Eq. (PT|) for static 

cases confirms the validity of the expression of the heat Eg. (|20|) . 



V. SUMMARY 



In conclusion, an expression of the microscopic reversibility for classical open systems is rigorously derived by 
taking into account the conservation of the probability. Remarkably, it directly connects the probabilities for time 
forward and reversed trajectories as an time reversal asymmetry of the final state distribution. The probability 
of the forward and reversed trajectory would be different in the presence of dissipation, which is expressed by the 
asymmetry factor. Also, the initial state and interaction between the system and reservoir are arbitrary. Then its 
properties are investigated. If the total system would thermalize after the initial transient (27l [29l-l33|. the forward 
and reversed probabilities arc almost equal, which is consistent with the results for qunatum systems based on the 
two-point measurement ^27„ 2&\- This would be regarded as a nonequilibrium generalization of the detailed balance 
principle. We also derived a microscopic expression of the heat, which reasonably yields Clausius equality for quasi 
static processes. 
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Appendix A: Conservative and dissipative dynamics 



Here, we show two concrete examples of both conservative and dissipative dynamics where the microscopic re- 
versibihty holds. This would make clear how the conservation of the probability actually looks like. Discussions on 



the conservative case is especially useful to compare with the corresponding quantum version 27] . The most funda- 
mental conservative dynamics is the Hamiltonian dynamics. Since the perturbation acts only on the system, the total 
Hamiltonian is given as 

H = Hs{t) + Hr + H,r, (Al) 

where Hs(t), Hr, and H^r are Hamiltonians of the system, reservoirs, and interactioon between them, respectively. 
Unlike the quantum case where the system is submitted to a thermalization after a quench, the interaction energy 
Hsr needs not be small compared with bulk energies Hg and Hr. Also the time dependence of Hs{t) is arbitrary and 
p(r, T) can be out of equilibrium. These points are in marked contrast with the microscopic reversibility of quantum 

open systems. In the present case, calculations are greatly simplified due to the conservative property ^ = 0, 

which amounts to | ^g^T^ | = 1, and conservation of the probability is p(V^"'^r,0) = p(r,T), which accounts for the 
Hamiltonian time evolution during < t <T. 

As an important case of reversible but non-conservative system, we focus on Nose-Hoover dynamics, since it would 
not be obtained by coarse graining of Hamiltonian dynamics. Note that the dynamics is dissipative due to the presence 
of a thermostat. Analysis here provides a concrete example where the dissipation actually comes into the calcuation. 
Let us consider the D dimensional A'^-particle system, which obeys the equation of motion 

■ - El 

m 

dV{xi,...,XDN,t) 



dxi 



C = a , (A2) 

2 

where m is the mass, ^ mimics the thermostat and a is a measure of the relaxation rate. (^) — ^ gives the kinetic 
temperature. We regard Ts — {xi,pi} as system variables. The Liouvillian operator acts on the distribution p{Ts, ^, t) 
as 

DN „ 

^-^ m dxi 

i—l 

-W.^ dx. + + ac"^^^) 

= -{Lit)-DNC{t))p{TsX,t). (A3) 



Then the phase volume varies in time 

lp{Tsit),at),t) = DNat)pirsit),at),t), (A4) 

and 

p{Tg{t)X{t), t) = e/o ^^C(^)''V(r.(0), C(0), 0), (A5) 

which corresponds to the Liouville theorem. Let us abbreviate the time evolution operator of the variable V s and C 
as V. We also denote (Vr)^ as VC- The conservation of the probability is then 

e^o ^^';(*)'^V((V"'r)„ V-^C, 0) = p{T, C, T) (A6) 
and the Jacobian is explicitly calculated as 



| g((vr)„vc) 
' 5(r,,c) 



= P- lo DNCis)ds 



(A7) 



Despite the phase volume contraction, the microscopic reversibility holds as the conservative case. 
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Appendix B: Generalized Liouville theorem 



In Eq. (fT2| . the Jacobian 



I dr I 



(Bl) 



is used. To show this, we divide the time interval [0,t] into NM many short intervals. First [0,t] is decomposed to 
TV intervals [nAt, (n + l)At] with At = so that external perturbation is approximately constant for each interval. 
Then the interval [nAt, (n + I) At] is further partitioned as [nAt + mAs, nAt +{m+ I) As] with As = We denote 
the j-th component of F as Tj and consider the case of two components for simplicity. Up to the first order of As, 
we have Fj(nAi + (m + l)As) = Tj{nAt + mAs) + TjinAt + toAs)As. And the Jacobian for the change of variables 
F(nAt + mAs) F(nAt + {m + I) As) is 



= 1 



3ri(t„„) 
9ri(t„„) 



As 



ari(t„„) 



As 



ar2(t„„) 



E 



dT,{tr. 



1 



■9r2(t„„) 
ari(t„„) 
, 8r2(t„, 



As 
4As 



As + 0(As2) 



(B2) 



where t„„i = nAt + toAs. For a fixed n, the value of the determinant is regarded as constant up to the first order of 
As, and the Jacobian for the change of variables F(t„o) r(^nM) is calculated as 



M 



lim 1 + 



d^M^t) At ^^E.IJf^A* 
dVjinAt) M 



(B3) 



Repeating a similar procedure for n and multiplying each factor, Eq. ()14p is derived 
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